Application of data compression methods to hypothesis testing for ergodic and stationary processes
نویسندگان
چکیده
We show that data compression methods (or universal codes) can be applied for hypotheses testing in a framework of classical mathematical statistics. Namely, we describe tests, which are based on data compression methods, for the three following problems: i) identity testing, ii) testing for independence and iii) testing of serial independence for time series. Applying our method of identity testing to pseudorandom number generators, we obtained experimental results which show that the suggested tests are quite efficient.
منابع مشابه
Universal Codes as a Basis for Time Series Testing
We suggest a new approach to hypothesis testing for ergodic and stationary processes. In contrast to standard methods, the suggested approach gives a possibility to make tests, based on any lossless data compression method even if the distribution law of the codeword lengths is not known. We apply this approach to the following four problems: goodness-oft testing (or identity testing), testing ...
متن کاملApplications of Universal Source Coding to Statistical Analysis of Time Series
We show how universal codes can be used for solving some of the most important statistical problems for time series. By definition, a universal code (or a universal lossless data compressor) can compress any sequence generated by a stationary and ergodic source asymptotically to the Shannon entropy, which, in turn, is the best achievable ratio for lossless data compressors. We consider finite-a...
متن کاملCompression-based methods for density estimation for time series
We address the problem of nonparametric estimation of the density for time series. We show that any universal code (or a universal data compressor) can be used as a basis for constructing an asymptotically optimal method for this problem for a certain class of stationary and ergodic processes.
متن کاملUsing Information Theory Approach to Randomness Testing
We address the problem of detecting deviations of binary sequence from randomness,which is very important for random number (RNG) and pseudorandom number generators (PRNG). Namely, we consider a null hypothesis H0 that a given bit sequence is generated by Bernoulli source with equal probabilities of 0 and 1 and the alternative hypothesis H1 that the sequence is generated by a stationary and erg...
متن کاملTesting Fiscal Reaction Function in Iran: An Application of Nonlinear Dickey-Fuller (NDF) Test
Abstract T his paper is to convince the usage of the nonlinear unit root tests when dealing with a nonlinear model. To do so, the stationary test for variables in a model titles “Fiscal Reaction Function in Iran” has been applied according to both the ordinary and the Nonlinear Dickey-Fuller (NDF) tests. Results show that while variables under investigation are stationary ...
متن کامل